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Abstract 


We  describe  an  approximation  method  for  solving  the  minimum 
makespan  problem  of  job  shop  scheduling.  It  sequences  the  machines 
one  by  one,  successively,  taking  •  each  time  the  machine  identified  as  a 
bottleneck  among  the  machines  not  yet  sequenced.  Every  time  after  a 
new  machine  is  sequenced,  all  previously  established  sequences  are 
locally  reoptimized.  Both  the  bottleneck  identification  and  the  local 
reoptimization  procedures  are  based  on  repeatedly  solving  certain 
one-machine  scheduling  problems.  Besides  this  straight  version  of  the 
Shifting  Bottleneck  Procedure,  we  have  also  implemented  a  version  that 
applies  the  procedure  to  the  nodes  of  a  truncated  search  tree. 
Computational  testing  shows  that  our  approach  yields  consistently  better 
results  than  other  procedures  discussed  in  the  literature.  A  high  point 
of  our  computational  testing  occurred  when  the  enumerative  version  of 
the  Shifting  Bottleneck  Procedure  found  in  a  little  over  five  minutes  an 
optimal  schedule  to  a  notorious  ten  machines/ ten  jobs  problem  on  which 
many  algorithms  have  been  run  for  hours  without  finding  an  optimal 
solution. 


1.  The  Problem 


The  job  shop  scheduling  or  machine  sequencing  problem  is  as  follows. 
Jobs  (items)  are  to  be  processed  on  machines  with  the  objective  of  minimizing 
some  function  of  the  completion  times  of  the  jobs,  subject  to  the  constraints 
that  (i)  the  sequence  of  machines  for  each  job  is  prescribed;  and  (ii)  each 
machine  can  process  only  one  job  at  a  time.  The  processing  of  a  job  on  a 
machine  is  called  an  operation;  its  time  (duration)  is  fixed,  and  it  cannot  be 
interrupted.  Here  we  choose  the  objective  of  minimizing  the  makespan,  i.e.  the 
time  needed  for  processing  all  jobs.  The  problem  can  then  be  stated  as 
■in  t 

n 


t.  -  t.  >  d.  (i,j)  *  A 

(P)  J  i  i 

t.  >  0,  i  *  N 

l  - 

t .  -  t.  >  d.  v  t.  -  t.  >  d.  (i,j)  *  E.,  k  *  M 
where  d.  is  the  (fixed)  duration  (processing  tine)  and  the  (variable) 
start  time  of  operation  i;  N  is  the  set  of  operations,  M  the  set  of  machines , 
A  the  set  of  pairs  of  operations  constrained  by  precedence  relations 
representing  condition  (i)  above,  while  is  the  set  of  pairs  of  operations 
to  be  performed  on  machine  k  and  which  therefore  cannot  overlap  in  tine,  as 
specified  in  (ii).  Any  feasible  solution  to  (P)  is  called  a  schedule .  For 
literature  on  this  subject,  see  [1,  4,  5,  8,  11]. 

It  is  useful  to  represent  this  problem  on  a  disjunctive  graph  [12,  2] 
6  =  (N,A,B),  with  node  set  n,  ordinary  (conjunctive)  arc  set  A,  and 
disjunctive  arc  set  E.  Figure  1  illustrates  this  graph  for  a  problem  with  14 
operations  (on  five  jobs)  and  four  machines.  The  nodes  of  G  correspond  to 
operations  (the  source  0  and  the  sink  n  are  the  dummy  "start”  and  "finish” 
operations),  the  directed  arcs  to  precedence  relations,  and  the  pairs  of 
disjunctive  arcs  to  pairs  of  operations  to  be  performed  on  the  same  machine. 


He  will  denote  by  D  =  (N,A)  the  directed  graph  obtained  from  G  by 
removing  all  the  disjunctive  arcs.  A  selection  in  B^  consists  of 

exactly  one  member  of  each  disjunctive  arc  pair  of  B^.  A  selection  is 
acyclic  if  it  contains  no  directed  cycle.  Each  acyclic  selection 
corresponds  to  a  unique  sequence  of  the  operations  pertaining  to  machine 
k,  and  vice-versa.  Thus  sequencing  a  machine  k  means  choosing  an  acyclic 
selection  in  B^.  A  complete  selection  S  consists  of  the  union  of 
,  one  in  each  E^,  k  *  M.  Picking  a  complete  selection  Sf  i.e. 
replacing  the  disjunctive  arc  set  B  by  the  ordinary  (conjunctive) 
arc  set  S,  gives  rise  to  the  (ordinary)  directed  graph  Dg  =  (N.AUS). 
A  complete  selection  S  is  acyclic  if  the  digraph  Dg  is  acyclic  (notice  that 
if  S  is  acyclic  then  each  S^,  k  t  H,  is  acyclic,  but  the  converse  is  not 
true).  Bvery  acyclic  complete  selection  S  defines  a  family  of  schedules, 
and  every  schedule  belongs  to  exactly  one  such  family.  Further,  the 
makespan  of  a  schedule  that  is  optimal  for  S  is  equal  to  the  length  of  a 


selections 


longest  path  in  Dg.  Thus  in  the  language  of  disjunctive  graphs,  our  problem 
is  that  of  finding  an  acyclic  caaplete  selection  S  c  B  that  ainiaizes  the 
length  of  a  longest  path  in  the  directed  graph  Dg. 

2.  The  Approach 

Job  shop  scheduling  is  among  the  hardest  combinatorial  optimization 
problems.  Not  only  is  it  NP-complete  [6],  but  even  among  members  of  the 
latter  class  it  belongs  to  the  worst:  we  can  solve  exactly  randomly  generated 
traveling  salesman  problems  with  300-400  cities  (over  100,000  variables)  or  set 
covering  problems  with  hundreds  of  constraints  and  thousands  of  variables, 
but  we  are  typically  unable  to  schedule  optimally  ten  jobs  on  ten  machines. 
Since  job  shop  scheduling  is  a  very  important  everyday  practical  problem,  it 
is  therefore  natural  to  look  for  approximation  methods  that  produce  an 
acceptable  schedule  in  useful  time. 

Most  of  the  heuristic  job  shop  scheduling  procedures  described  in  the 
literature  are  based  on  "priority  dispatching”  rules.  These  are  rules  for 
choosing  an  operation  from  a  specified  subset  to  be  scheduled  next.  They 
include  such  criteria  as  SPT  (shortest  processing  time),  MWKR  (most  work 
remaining),  FCFS  (first  come,  first  Berved),  etc.  The  subset  of  eligible 
operations  is  designed  to  produce  either  an  "active”  schedule  (i.e.  such  that 
no  operation  can  be  started  earlier  without  delaying  some  other  operation)  or 
a  "nondelay"  schedule  (i.e.  such  that  no  machine  is  idle  at  a  time  when  it 
could  begin  executing  some  operation).  These  are  one-pass  procedures  of  the 
greedy  type,  in  that  they  construct  a  solution  through  a  sequence  of 
decisions  based  on  what  seems  locally  best,  and  the  decisions  once  made  are 
final.  Like  most  procedures  of  this  type  in  other  areas  of  optimization,  these 
heuristics  are  fast,  and  they  usually  find  solutions  that  are  not  too  bad.  In 


many  situations  this  is  all  that  is  needed,  and  so  their  use  is  justified. 
However,  with  the  rapid  increase  in  the  speed  of  computing  and  the  growing 
need  for  efficiency  in  scheduling,  it  becomes  increasingly  important  to  explore 
ways  of  obtaining  better  schedules  at  some  extra  computational  cost,  short  of 
going  all  the  way  towards  the  usually  futile  attempt  of  finding  a  guaranteed 
optimal  schedule.  Our  paper  describes  an  approach  meant  to  acqomplish  this 
goal. 

We  sequence  the  machines  one  at  a  time,  consecutively.  In  order  to  do 
this,  for  each  machine  not  yet  sequenced  we  solve  to  optimality  a  one-machine 
scheduling  problem  that  is  a  relaxation  of  the  original  problem,  and  use  the 
outcome  both  to  rank  the  machines  and  to  sequence  the  machine  with  highest 
rank.  Every  time  a  new  machine  has  been  sequenced,  we  reoptimize  the 
sequence  of  each  previously  sequenced  machine  that  is  susceptible  to 
improvement  by  again  solving  a  one-machine  problem. 

Our  method  of  solving  the  one-machine  problems  is  not  new;  although  we 
have  speeded  up  by  an  order  of  magnitude  the  time  required  for  generating 
these  problems.  Instead,  the  main  contribution  of  our  approach  is  the  way  we 
use  this  relaxation  to  decide  upon  the  order  in  which  the  machines  should  be 
sequenced.  This  is  based  on  the  classic  idea  of  giving  priority  to  bottleneck 
machines. 

There  is  more  than  one  way  in  which  a  machine  can  be  viewed  as  a 
bottleneck.  A  first  concept  of  this  type  is  that  of  criticality.  Given  a 
selection  S  =  U  (S^  :  k«M)  and  the  corresponding  digraph  Dg,  we  say  that 
machine  k  is  critical  with  respect  to  S  (or  the  schedule  associated  with  S) 

in  Dg.  This  definition  certainly 
makes  sense  in  view  of  the  known  fact  [2]  that  any  schedule  better  than  the 
one  associated  with  S  uses  a  selection  in  which  at  least  one  arc  of  every 


if  has  some  arc  on  a  longest  path 


longest  path  in  Dg  is  reversed.  While  appealing  and  theoretically  justified, 
this  notion  is  however  not  sufficiently  operational  for  our  purposes:  it  simply 
partitions  the  set  of  machines  into  critical  and  noncritical  ones  without 
offering  means  of  distinguishing  between  degrees  of  criticality.  In  order  to 
prioritize  the  machines,  we  need  a  concept  that  expresses  the  bottleneck 
quality  as  a  matter  of  degree  rather  than  a  yes  or  no  property.  This  quality 
could  be  measured,  for  instance,  by  the  marginal  utility  of  the  machine  in 
reducing  the  makespan,  were  it  not  for  the  practical  difficulty  of  assessing 
the  latter.  Instead,  we  use  aa  a  measure  of  the  bottleneck  quality  of  machine 
k  the  value  of  an  optimal  solution  to  a  certain  one-machine  scheduling 
problea  on  nachine  k.  To  be  sore  specific,  let  Mg  c  M  be  the  set  of  machines 

that  have  already  been  sequenced  by  choosing  selections  S^,  p  t  Mg,  and  let 

(P(k,M0))  be  the  problem  obtained  from  (P)  by  (i)  replacing  each  disjunctive 
arc  set  Ep,  p  e  Mg,  by  the  corresponding  selection  Sp,  and  (ii)  deleting 
each  disjunctive  arc  set  Ep,  p  *  M  \  Mg,  p  f  k.  This  problem  is  equivalent 
to  minimizing  maximum  lateness  in  a  one-machine  scheduling  problem  (for 
nachine  k)  with  due  dates.  Machine  m  is  then  called  the  bottleneck  among 
the  machines  indexed  by  M  \  Mg  if  v(n,Mg)  =  max{v(k,Mg)  :  k  e  M  \  Mg},  where 
v(k,Mg)  is  the  value  of  an  optimal  solution  to  (P(k,Mg)). 

A  brief  statement  of  the  Shifting  Bottleneck  Procedure  is  as  follows. 
Let  Mg  be  the  set  of  machines  already  sequenced  (Mg  =  ♦  at  the  start). 

Step  1.  Identify  the  bottleneck  machine  m  among  the  machines 

k  «  M  \  Mq  and  sequence  it  optimally.  Set  Mg  *■  Mg  U  {a}  and  go  to  2. 

Step  2.  Reoptimize  the  sequence  of  each  critical  machine  k  t  Mg  in 
turn,  while  keeping  the  other  sequences  fixed.  Then  if  Mg  =  M,  stop;  other¬ 
wise  go  to  1. 

The  details  are  discussed  in  the  next  three  sections. 


3.  An  0(n)  Longest  Path  Algorithm 

To  identify  in  Step  1  the  next  bottleneck  machine  to  be  sequenced, 
for  each  k  «  M  \  Mq  we  solve  the  problem 
■in  t 


(P(k,M0)) 


t.  -  t.  >  d. 
J  1-1 

t.  >  0 

l  - 


(i.j)  «  U  (Sp  :  p«MQ)  u  A 
i  «  N 


*j  "  *i  -  di  v  *i  ~  *j  -  dj  (i»j)  *  Bk 


Also,  to  reoptinize  in  Step  2  the  sequence  of  each  critical  machine 
k  *  Mq,  for  each  such  machine  we  solve  a  problem  of  the  form  (P(k,Mp) ) 
for  some  subset  Mq  c  Mq. 

Problem  (P(k,MQ))  is  equivalent  to  that  of  finding  a  schedule  for  machine 
k  that  minimizes  the  maximum  lateness,  given  that  each  operation  i  to  be 


performed  on  machine  k  has,  besides  the  processing  time  d^,  also  a  release 
time  rA  and  a  due  date  f^;  where  is  the  length  of  a  longest  path  from 
source  to  node  i  in  DT,  and  f^  is  the  difference  between  the  length  of  a 
longest  path  from  source  to  sink  and  that  of  a  longest  path  from  node  i  to  the 
sink,  in  D^,  with  T  :=  U  (Sp  :  p«Mq).  This  latter  problem  in  turn  can  be 
viewed  as  a  minimum  makespan  problem  where  each  job  has  to  be  processed 


in  order  by  three  machines,  M^,  M2  and  Mg,  of  which  and  Mg  have 
infinite  capacity  while  Mg  processes  one  job  at  a  time,  and  where  the 
processing  time  of  job  i  is  on  M^,  dA  on  Mg,  and  q^  :=  L  -  on  Mg, 
with  L  equal  to  the  length  of  a  longest  source-sink  path  in  D,p.  The  numbers 


r A  and  qi  are  sometimes  referred  to  as  the  "head"  and  the  "tail"  of  job  i. 
Thus  the  one-machine  problems  that  we  solve  during  the  algorithm  are 


of  the  form 


■in  t 

n 


>  d.  +  q. 
-  1 


i  «  N* 


P*(k,M0)  t.  >  r. 

*j  *  ‘i  *  dl  *  ‘i  '  *j  i  di  (i-J)  *  \ 
where  the  and  are  defined  aa  above*  and  N*  is  the  set  of  jobs  to  be 

processed  on  Machine  k  (corresponding  to  Mg  in  this  aodel). 

In  order  to  set  up  problen  P*(k,Mg)  we  have  to  solve  2|n*|  longest  path 
problems  in  to  calculate  the  numbers  rv  and  q^.  Solving  a  longest 

path  problew  in  an  acyclic  network  on  |N*|  nodes  by  standard  methods 
takes  0(|N*|2)  time.  We  use  instead  an  0(|n*|)  algorithm  that  takes 
advantage  of  the  special  structure  of  the  digraphs  on  which  our  problems 
are  defined. 

Typically,  the  digraphs  are  quite  dense:  they  contain  a  complete 

subgraph  for  every  p  *  Mg.  However,  it  is  well  known  that  an  acyclic 

complete  directed  graph  is  the  transitive  closure  of  its  unique  directed 

Hamilton  path.  Therefore,  of  the  |s  |(|s  |-1)  /  2  arcs  of  each  such 

P  P 

subgraph,  only  the  |s^|  arcs  that  form  the  unique  Hamilton  path  in  the 
subgraph  are  of  consequence  for  the  longest  path  calculation;  the  rest 
can  be  deleted  or  simply  ignored.  In  the  resulting  digraph,  say  D*j, 
every  node  except  for  the  source  and  sink  has  at  least  one  and  at  most 
two  predecessors  (successors).  The  labeling  algorithm  based  on  Bellman’s 
equations  can  then  be  modified  as  follows. 

A  node  i  can  be  labeled  when  its  predecessors  have  been  labeled.  We 
keep  all  labeled  nodes  in  a  queue.  To  start,  we  label  the  source  node  and 
place  it  into  the  queue.  Then  we  repeatedly  apply  the  following 


7 


Iterative  step.  Pick  the  next  node  from  the  head  of  the  queue,  say  i, 


remove  it  from  the  queue,  and  for  each  successor  j  of  i  in  D^> 

|  —  check  whether  j  can  be  labeled 

—  if  so,  label  j  and  append  it  to  the  tail  of  the  queue. 

Stop  when  the  queue  is  empty. 

Bach  node  i  has  at  most  two  successors  in  D*»  and  a  successor  j  of  i 

i  i 

i  has  at  aost  one  predecessor  other  than  i;  hence  the  Iterative  Step  takes 

i 

constant  tine,  and  it  is  applied  |N*|  tines.  Thus  the  algorithm  takes 
0(|N*|)  tine. 

i 

In  our  implementation,  the  graph  D*  is  not  constructed  explicitly. 
Rather  than  delete  the  redundent  arcs,  we  keep  two  sets' of  lists:  a  "job 
list"  for  each  job,  containing  the  sequence  of  operations  pertaining  to  that 

I 

job,  and  a  "machine  list”  for  each  machine  already  sequenced,  containing  the 

I 

|  sequence  of  operations  pertaining  to  that  machine.  Every  node  then  appears 

on  exactly  one  job  list  and  exactly  one  machine  list;  and  its  predecessors 

I 

!  and/or  successors  are  its  neighbors  on  the  two  lists. 

i 

|  While  the  central  idea  of  the  shifting  bottleneck  procedure  does  not 

|  depend  on  the  way  one  solves  the  longest  path  problems  encountered,  speeding 

i 

’  up  by  an  order  of  magnitude  the  time  required  for  the  longest  path  calcula¬ 

tions,  which  is  the  most  time-consuming  part  of  our  procedure,  has  had  a  major 
|  effect  on  the  overall  efficiency  of  the  latter. 


4.  Solving  the  One-Machine  Problem 

Having  generated  a  problem  P*(k,Mg),  we  then  solve  it  by  the  algorithm  of 
Carlier  [3],  which  is  closely  related  to  the  one  by  McMahon  and 
Florian  [9].  Although  this  problem  is  NP-complete  in  the  strong  sense  [6], 
both  of  the  above  algorithms,  which  are  of  the  branch  and  bound  type,  are 


known  to  be  able  to  solve  in  a  matter  of  seconds  fairly  large  problems  with 
data  drawn  from  a  realistic  range:  Lenstra  [8]  and  Rinnooy  Kan  [11]  report 
favorable  results  with  the  algorithm  of  [9]  on  problems  with  up  to  80  jobs; 
Carlier  [3]  reports  excellent  results  with  his  version  of  the  algorithm  on 
problems  with  up  to  1,000  jobs. 

For  the  sake  of  completeness,  we  outline  here  the  version  of  Carlier’s 

algorithm  that  we  implemented.  For  details  the  reader  is  referred  to  [3]. 

At  every  node  of  the  branch  and  .bound  tree,  a  heuristic  based  on  the 

MWKR  (most  work  remaining)  priority  dispatching  rule  is  applied  to  the 

current  one-machine  problem.  To  be  specific,  we  start  by  setting 

t  =  min{r .  :  j  e  N*},  S  =  N*,  and  then  repeatedly  execute  the  following 
J 

Iterative  Step .  Among  the  unscheduled  jobs  ready  to  be  scheduled  at 

tine  t  (i.e.,  those  j  t  S  such  that  r.  <.  t),  choose  one,  say  j,  with  the 

J 

greatest  (if  there  are  ties,  break  them  by  giving  preference  to  the 

greatest  d.),  and  schedule  it  by  setting  t .  :=  t,  S  :=  S  \  {j} .  Then  if 
*  J 

S  =  ♦,  stop;  otherwise  set  t  :=  max{t.  +  d.,  min{r .  :  j  e  S> }  and  return. 

«  J  J 

Along  with  the  schedule  generated  by  the  above  heuristic,  we  obtain  a 
critical  path  in  the  disjunctive  graph  associated  with  the  problem.  Let 
j(l),  ...,  j(p)  be  the  nodes  on  this  critical  path  other  than  the  source  and  sink 
(in  case  of  multiple  critical  paths,  any  one  can  serve).  Let  k  be  the  lar¬ 
gest  integer  in  (1,  . . . ,  p}  such  that  j  (k)  ^  qj(p)*  let 

J  =  (j(k+l),  ...,  j(p)}.  The  set  J  plays  two  roles.  First, 

h(J)  :=  min{r^  :  i  e  J}  +  J(d^  :  iej)  +  min{q^  :  i  e  J) 
is  easily  seen  to  be  a  lower  bound  on  the  minimum  makespan.  Second,  it  can 
be  shown  that  in  any  optimal  schedule  job  j(k)  comes  either  before  or  after 
all  jobs  i  *  J. 


While  the  lower  bound  h(J)  can  be  used  to  discard  nodes  of  the  branch 
and  bound  tree  for  which  the  upper  bound  is  attained,  the  dichotomy  defined 
by  the  position  of  j(k)  relative  to  J  can  serve  as  the  basis  of  a  branching 
rule.  Namely,  if  the  current  node  of  the  search  tree  cannot  be  discarded  by 
comparing  the  lower  and  upper  bounds,  it  can  be  replaced  by  two 
successor  nodes,  one  in  which  job  j(k)  has  a  new  tail  Qj (Jc) •  ^ar^e  enough 
to  force  the  heuristic  to  schedule  job  j(k)  before  all  i  t  J,  end  a  second 
one  in  which  job  j(k)  has  a  new  head  r^^)*  large  enough  to  have  job  j(k) 
scheduled  after  all  i  t  J. 

The  branch  and  bound  trees  generated  by  the  procedure  are  typically 
much  smaller  than  n,  and  they  rarely  exceed  2n. 

5.  The  Local  Reoptimization  Procedure 

Let  Mq  be  the  set  of  aachines  already  sequenced,  and  let  k(l),  k(p) 

be  an  arbitrary  ordering  of  Mq  (here  p  =  |Mq|).  By  a  local  reoptimization 
cycle  we  aean  the  following  procedure.  For  i  =  1,  p,  solve  the 

problem  (P*(k(i) ,MQ\{k(i)}))  and  substitute  the  optimal  selection  Sk(i)  f°r 
the  old  selection.  As  long  as  |Mq|  <  |m|  -  1,  we  go  through  at  most  three 
local  reoptimization  cycles  for  each  set  Mq.  At  the  last  step,  when 
|Mq|  =  |m|  -  1,  we  continue  the  local  reoptimization  to  the  point  where 
there  is  no  improvement  for  a  full  cycle. 

The  problems  (P*(k(i),MQ\{k(i)}))  encountered  during  local  reoptimization 
are  generated  and  solved  by  the  same  techniques  as  the  problems  (P*(k,Mg) ) , 
discussed  in  sections  3  and  4.  The  ordering  k(l),  ...,  k(p)  of  Mq  is  at 
first  given  by  the  order  in  which  the  machines  indexed  by  Mq  were  sequenced. 
Every  time  a  full  cycle  is  completed,  the  elements  of  Mq  are  reordered 


mmMmi 


according  to  decreasing  values  of  the  solutions  to  the  problem 
(P*(k(i),l^\{k(i)})). 

Finally,  upon  completion  of  the  local  reoptiaization  procedure 
for  a  given  Mq,  we  found  it  useful  to  repeat  the  procedure  after  temporarily 
removing  from  the  problem  the  last  (according  to  the  current  ordering)  a 
naocritical  machines,  i.e.  deleting  the  corresponding  selections  from 

the  associated  graph  (we  take  a  to  be  the  minimum  of  |Mq|*^  and  the  number  of 
naocritical  machines  in  Mq)  .  At  the  end  of  the  cycle,  the  machines  that  had 
been  removed  are  reintroduced  one  by  one,  successively,  and  the  cycle  is 
completed.  This  second,  modified  procedure  typically  finds  additional 
improvements. 

6.  Truncated  Enumeration 

.  As  the  computational  results  of  the  next  section  show,  the  shifting 
bottleneck  procedure  almost  always  obtains  considerably  better  schedules  than 
the  best  among  the  priority  dispatch  rule  heuristics,  and  it  frequently  finds 
an  optimal  schedule.  Nevertheless,  for  situations  when  the  quality  of  the 
schedule  is  sufficiently  important  to  justify  a  more  intensive  computational 
effort,  we  have  developed  a  second  version  of  our  approach,  which  applies  the 
shifting  bottleneck  procedure  as  described  above  to  the  nodes  of  a  truncated 
enumeration  tree. 

The  nodes  and  arcs  of  our  search  tree  can  be  described  as  follows. 

Every  node  corresponds  to  a  set  Mq  of  machines  that  have  been  sequenced. 

In  particular,  the  node  corresponding  to  a  given  Mq  represents  the  problem 

(P(Mn))  obtained  from  (P)  by  replacing  the  disjunctive  arc  sets  E  ,  p  *  Mn, 
u  p  u 

by  the  selections  Sp,  p  *  M.  Bvery  arc  corresponds  to  a  pair  of  sets  Mq, 
M^,  where  M^  =  Mq  U  {k}  for  some  k  «  Mq\  M  .  At  a  typical  node  of  the 


search  tree  corresponding  to  soae  set  Mq,  we  apply  to  (P(Mq)  )  the  shifting 
bottleneck  procedure  as  described  in  the  previous  sections,  with  the 
difference  that  whenever  we  rank  the  Machines  according  to  decreasing  v(k,Mg) 
in  order  to  identify  the  current  bottleneck,  we  store  a  certain  number  of  the 
one-aachine  problems  generated  for  further  exploration  later  in  the  process. 
To  be  specific,  for  a  node  corresponding  to  a  given  Mq,  we  store  as  successor 
nodes  in  the  search  tree  the  f(l)  highest  ranking  problems  (P*(k,Mg) ) , 
k  *  M  \  Mq.  Here  <  is  the  level  of  the  tree,  equal  to  |Mq | ,  and  f  is  a 
decreasing  function  of  4  whose  parameters  are  chosen  to  reflect  consider¬ 
ations  based  on  problem  size,  available  storage  space  and  limits  on  computing 
tine. 

A  second  instrument  for  limiting  the  size  of  the  search  tree  is  a  penalty 
function,  defined  for  every  node,  that  penalizes  the  choices  made  at  different 
levels  in  generating  the  node  in  question,  in  proportion  to  their  deviation 
from  the  bottleneck,  and  with  a  weighting  that  is  heavier  for  the  higher  than 
for  the  lower  levels  of  the  tree.  Whenever  the  value  of  the  penalty  function 
for  a  node  exceeds  a  predetermined  limit,  the  node  is  discarded. 

Whenever  a  node  of  the  search  tree  is  chosen  to  be  processed,  in 

keeping  with  the  bottleneck  principle  it  is  the  highest-ranking  unexplored 
node  among  the  successors  of  its  parent  node.  As  to  our  search  strategy,  we 
use  a  combination  of  breadth  first  with  depth  first.  In  a  first  phase,  we 
generate  all  the  nodes  provided  for  by  the  successor  function  f(<)  for  the 
levels  *  =  1,  ...,  **  (we  actually  use  **  =  At  the  end  of  this 

phase,  all  the  active  nodes  of  the  search  tree  are  on  level  t *,  Further,  they 

form  groups  of  f (**)  nodes,  each  group  containing  the  successors  of  a  node 
on  level  I*  -  1.  Next  we  switch  to  a  procedure  that  selects  the 

highest-ranking  member  of  one  of  the  groups,  based  on  an  evaluation  defined 


for  every  group,  and  explores  the  associated  branch  straight  to  the  bottom  of 
the  search  tree,  or  as  far  as  the  penalty  function  permits.  Naturally,  the 
current  best  solution  value  is  always  stored  as  an  upper  bound,  and  branches 
on  which  the  upper  bound  is  attained  are  abandoned.  When  the  bottom  of 
the  tree  is  reached  or  further  advance  along  a  branch  is  foregone  because  of 
the  penalty  function  or  the  bound,  we  select  the  highest-ranking  member  of 
another  group  of  nodes  and  continue. 

7.  Computational  Experience 

A  FORTRAN  implementation  of  the  Shifting  Bottleneck  procedure  was 
tested  on  a  VAX  780/11,  on  problems  taken  from  the  literature  or  generated 
for  the  purposes  of  this  experiment.  The  problems  range  from  small  ones,  for 
which  an  optimal  solution  was  known,  to  problems  involving  up  to  500 
operations. 

The  problems  in  Tables  1  and  2  have  the  following  characteristics.  All 
jobs  have  to  be  processed  on  all  machines  (except  for  Problem  1,  which  has  a 
more  special  structure).  The  sequence  of  machines  for  each  job  is  randomly 
generated  from  a  uniform  distribution.  Problem  1  is  from  (81,  problems  2,  3 
and  4  are  from  [10],  problems  10-15  are  from  [7],  while  the  remaining  problems 
were  generated  by  the  authors,  with  processing  times  randomly  drawn  from  a 
uniform  distribution  on  the  interval  [50,  100]  for  problem  5,  [25,  100]  for 
problem  6,  [11,  40]  for  problems  7,  8,  9,  and  [5,  99]  for  problems  16-19.  The 
Tables  give  the  dimensions  of  the  problems  and  the  results  obtained  by 
solving  them  with  the  Shifting  Bottleneck  procedure  in  its  straight  version 
(SBI),  as  well  as  in  its  enumerative  version  (SBII). 

As  the  results  show,  SBI  took  on  the  order  of  one  to  two  minutes  for  the 
larger  problems,  although  it  involved  hundreds  of  micro-runs,  i.e.  one-machine 
problems.  The  degree  of  difficulty  of  solving  a  problem  by  SBI  of  course 


Value,  aicro-runs,  aacro-runs,  LB:  see  Table 
*  optiaal  value,  proved  to  be  optiaal 


sharply  increases  with  the  number  of  machines.  However,  for  a  given  number 
of  machines,  an  increase  in  the  number  of  jobs  does  not  seem  to  make  the 
problem  more  difficult;  on  the  contrary,  while  the  computational  effort  shows  a 
moderate  increase,  the  quality  of  the  solutions  found  seems  to  improve.  In  all 
the  problems  with  ten  machines  and  30  or  more  jobs,  without  exception,  the 
optimal  solution  was  found  by  SBI  and  was  proved  to  be  optimal,  because  the 
lower  bound  provided  by  the  bottleneck  problem  on  the  first  level,  i.e.  the 
value  max{v(k,4)  :  k  *  M),  was  not  exceeded  by  the  makespan  of  the  schedule 
found  by  the  procedure.  Naturally,  in  these  cases  the  proven  optimality  of 
the  solution  has  eliminated  the  need  to  apply  SBII.  This  seems  to  be  quite  a 
remarkable  property  of  the  Shifting  Bottleneck  Procedure. 

Among  the  problems  of  Table  1,  Problem  3  is  the  notorious  ten  jobs/ten 
machines  problem  from  Muth  and  Thompson  [10,  p.  236]  that  has  defied 
solution  for  more  than  20  years  in  spite  of  the  fact  that  every  available 
algorithm  was  tried  on  it.  Over  the  years,  better  and  better  solutions  were 
discovered,  usually  in  computer  runs  that  took  several  hourB  and  generated 
tens  of  thousands  of  Bearch  tree  nodes.  A  couple  of  years  ago,  a  solution 
with  a  value  of  930  was  found  (a  new  record  at  the  time)  at  the  end  of  just 
such  a  long  run.  More  recently  J.  Carlier  and  E.  Pinson  have  announced  that 
after  another  long  run  that  generated  22,000  nodes  in  five  hours  on  a  Prime 
2655  computer  this  solution  was  proved  to  be  optimal  [8a].  The  enumerative 
version  of  the  Shifting  Bottleneck  procedure  found  this  solution  in  just  over 
five  minutes  of  VAX  780/11  time  (without,  however,  proving  optimality). 

In  order  to  compare  our  procedure  with  other  methods,  we  solved  40  test 


problems  generated  by  Lawrence  [7]  that  were  also  solved  by  him  with  ten 
different  procedures  based  on  priority  dispatching  rules,  both  straight  and 
randomized.  In  these  40  problems,  each  job  is  to  be  processed  on  every 
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machine,  the  aequence  of  machinea  for  each  job  ie  random,  and  the  processing 
timea  are  randomly  drawn  integers  from  the  interval  [5,  99].  (Problems  1,  2  of 
Tables  7,  8,  9  are  the  same  as  Problems  10-15  of  Table  2.) 

The  ten  priority  dispatching  rules  (p.d.r.'s  in  the  Bequel)  used  by 
Lawrence  are  as  follows: 

1.  FCFS  (First  Come  First  Served).  Select  the  operation  that 
becomes  available  at  the  earliest  time. 

2.  LST  (Late  Start  Time).  Select  the  operation  with  earliest  late 
start  time  (same  as  MWKR). 

3.  EFT  (Early  Finish  Time).  Select  the  operation  that  can  be 
finished  earliest. 

4.  LFT  (Late  Finish  Time).  Select  the  operation  with  the  earliest 
late  finish  time. 

5.  MINSLK  (Minimum  Slack).  Select  the  operation  with  minimum  slack 
time. 

6.  SPT  (Shortest  Processing  Time).  Select  the  operation  with  the 
shortest  processing  time. 

7.  LPT  (Longest  Processing  Time).  Select  the  operation  with  the 
longest  processing  time. 

8.  MIS  (Most  Immediate  Successors).  Select  the  operation  with  the 
largest  number  of  successors. 

9.  FA  (First  Available).  Select  the  first  available  operation. 

10.  RANDOM.  Select  randomly  among  the  available  operations. 

These  p.d.r.'s  were  first  applied  in  a  straightforward  fashion,  then  each  of 
them  was  randomized.  The  randomized  rule  is  to  select  one  of  the  available 
operations  at  random  from  a  probability  distribution  which  makes  the  odds  of 
being  selected  proportional  to  the  priority  assigned  to  each  operation  by  the 


given  dispatching  rule.  The  run  is  then  repeated  ten  times*  and  the  best 
result  obtained  is  reported. 

On  the  40  test  problems*  none  of  the  ten  priority  dispatching  rules 
dominated  all  the  others.  Eight  of  the  ten  rules  gave  the  best  result  on  at 
least  one  problem;  the  remaining  two*  LPT  and  FA,  were  never  best.  Since  the 
computing  times  required  by  any  of  the  p.d.r.-based  procedures  are  modest 
(although  much  less  so  in  the  randomized  than  in  the  straight  case),  we  chose 
the  best  of  the  ten  results  for  each  problem  and  recorded  as  computing  time 
the  sum  of  the  CPU  times  for  the  runs  with  the  eight  rules  that  were 
effective  in  at  least  one  case  (in  other  words*  we  simply  ignored  the  time  for 
the  runs  with  the  two  rules  that  proved  ineffective).  Tables  3-10  show 
the  results*  alongside  with  those  obtained  for  the  straight  and  the 
enumerative  versions  of  the  Shifting  Bottleneck  Procedure  (SBI  and  SBII, 
respectively). 

As  the  tables  show,  the  straight  version  of  the  Shifting  Bottleneck 
Procedure  (SBI)  finds  solutions  that  are  most  of  the  time  (in  38  out  of  the  40 
cases)  better  than  the  solutions  found  by  the  p.d.r.-based  procedures, 
whether  in  their  straight  or  randomized  version*  at  a  computational  cost  that 
is  usually  comparable  to  that  of  the  straight  p.d.r.-based  procedure*  but  at 
least  an  order  of  magnitude  lower  than  that  of  the  randomized  version  of  the 
procedure. 

* 

Further,  the  enumerative  version  of  the  Shifting  Bottleneck  Procedure 
(SBII)  most  of  the  time  finds  substantially  improved  solutions  over  those  found 
by  the  straight  version.  In  order  to  make  the  comparison  between  SBII  and 
the  p.d.r.-based  procedures  conclusive*  SBII  was  run  on  each  of  the  40 
problems  with  a  time  limit  set  to  the  CPU  time  required  by  the  randomized 
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p.d.r.-based  procedure  on  each  of  the  problems.  The  result,  as  shown  in  the 
Tables,  is  that  the  SBII  solution  is  always,  without  exception,  at  least  as  good 
as  that  found  by  the  randomized  p.d.r.-based  procedure  in  the  same  amount  of 
time,  and  in  the  vast  majority  of  the  cases  it  is  considerably  better.  The 
typical  improvement  is  somewhere  between  4  per  cent  and  10  per  cent. 
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